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MULTIPLE CANNULA IMAGE GUIDED 
TOOL FOR IMAGE GUIDED PROCEDURES 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application is a divisional of United States Patent Serial No. 
09/795,126, filed on March 1, 2001, which claims the benefit of U.S. Provisional 
Serial No. 60/186,200, filed March 1, 2000. The disclosures of the above 
applications are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

[0002] The present invention is directed generally to image-guided 
medical procedures, and more particularly, to instrumentation for the optimal 
placement of multiple surgical implements using image-based surgical guided 
navigation systems. 

2. Description of the Related Art 

[0003] Many surgical procedures include a surgeon placing multiple 
implements within a patient's body. Some of these procedures dictate implement 
placement in a specific geometry to maximize the effectiveness of the treatment. 
Certain factors, such as the characteristics of the patient's anatomy, can also 
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influence the desired relative placement of the multiple implements. Some 
procedures place the implements at a specified angle relative to each other, 
while others may use a parallel arrangement. One such procedure which utilizes 
a parallel configuration is the fixation of a femoral neck fracture. Typically, this 
type of fracture is stabilized utilizing three parallel cannulated screws. Each 
screw is placed perpendicularly to the fracture site and in such a manner that the 
distance between each screw is equal, thus forming an equilateral triangle. 
Parallel placement of the screws is desired so that the bones are properly pulled 
together. If the screws are not placed in such a parallel manner, shearing forces 
at the fracture site can prevent proper healing. Furthermore, the triangular screw 
arrangement increases the stability of the fracture fixation and prevents rotation 
between the bone fragments. Studies have suggested that three screws are an 
optimal number since additional implements provide no strength advantage and 
additional screw penetration increases risk. Femoral neck fracture stabilization 
using this method can be performed percutaneously while the patient is under 
regional anesthesia, thus reducing risk associated with more invasive 
procedures. 

[0004] Traditional techniques to accurately position and orient 
implements have included the use of x-ray images to localize the position of the 
implement tool guide. Through the continuous acquisition of x-ray images during 
the medical procedure, real-time placement of the tool guide relative to the 
patient's anatomy can be displayed. More recently, fluoroscopically-based 
surgical navigation systems have been employed for tool guide positioning by 
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tracking the tool and superimposing its representation onto pre-acquired images 
without requiring x-rays to be continually taken during the actual surgical 
procedure. 

[0005] Current practice for multiple implement placement utilizing 
image-based surgical navigation systems typically employs tracked guides which 
contain a single cannula. As used herein, the term cannula refers to a tubular 
member having at least one hollow channel (i.e., lumen), for insertion in and/or 
placement adjacent to a patient's body. Such an instrument could be used to 
place implements in and/or adjacent to a patient by positioning the cannula in the 
region of interest, and then placing the implement in the region by means of the 
channel. As used herein, the term implement refers to a surgical tool or device 
for performing medical procedures. An implement could be a drill, a guide wire, 
or implants such as screws, nails, etc. 

[0006] Those skilled in the art should recognize that there are many 
different types of cannulas and many different ways in which cannulas could be 
used. For example, a cannula could be rigid, semi-rigid, or flexible and could be 
configured in any number of different forms, such as a catheter, needle, 
endoscope, implement inserter, etc. 

[0007] Utilizing a single cannula means the surgeon typically will 
position each implement individually. The procedure usually starts by attaching a 
reference tracking frame to the surgical anatomy. X-ray images are then taken 
utilizing a fluoroscopic imager which is also tracked by the navigation system. 
The surgeon then positions the tracked guide for the first implement with the aid 
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of the navigational system display. Once the tool guide is properly positioned, the 
cannula is used to place the guide wire and subsequent implement into the 
desired anatomical site. The next implement is then placed relative to the first, 
and so on. In order for the surgeon to properly place the subsequent implement 
relative to the previous, new images are taken with the previous implement in 
place. 

[0008] One difficulty of the current practice is in achieving relative 
accuracy of the implement placement. To achieve the desired relative implement 
geometry, the surgeon estimates each trajectory individually based upon the 
prior implements. Thus, the relative accuracy is based on the physician's 
estimate. Furthermore, each implement may involve generating a new set of 
images of the patient's anatomy before the subsequent implement can be placed, 
which can increase the time of the procedure and radiation exposure to both the 
patient and operating room personnel. 

SUMMARY OF THE INVENTION 
[0009] The present invention is directed generally to image guided 
medical procedures, and, particularly, medical procedures which utilize surgical 
implements. More specifically, the present invention is directed to an apparatus 
and method for the combined positioning of multiple implements, especially those 
that may be placed in a specific relative geometry. 
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[0010] As embodied and broadly described herein, certain aspects of 
the invention are directed to a multiple cannula tool guide for use in conjunction 
with image-guided surgical navigation systems. 

[0011] In one aspect of the invention, an apparatus for use in image 
guided surgery is presented. The apparatus comprises: an instrument location 
system for detecting position, where the instrument location system includes a 
computer processor; a tool guide comprising a plurality of cannulas; and at least 
one trackable marker provided on the tool guide for detection by the instrument 
location system; a memory coupled to the computer processor stores: at least 
one pre-acquired image of a patient having an image space, and instructions, to 
be executed by the computer processor, to align the image space to a detector 
space, to track a three-dimensional position of the tool guide in the detector 
space, and to compute a projection of the tool guide into the at least one pre- 
acquired image. 

[0012] In another aspect of the invention, an apparatus for the 
placement of surgical implements is presented. The apparatus comprises: a 
plurality of cannulas coupled to a fixture, where at least one trackable marker 
associated with the cannulas; a plurality of surgical implement receivers provided 
on the fixture for receiving surgical implements; and at least one of the plurality of 
receivers being substantially coaxially aligned with a respective one of the 
plurality of cannulas. 

[0013] In another aspect of the invention, an apparatus for the 
placement of surgical implements, is presented. The apparatus comprises: a 
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plurality of cannulas, where at least one of the plurality of cannulas is adjustable 
to vary its length; a fixture coupled to the plurality of cannulas, where the fixture 
can accommodate at least one of the plurality of cannulas being individually 
adjustable to vary at least one of its angular position; and at least one trackable 
marker associated with the cannulas. 

[0014] In another aspect of the invention, a method for guiding a 
medical instrument for use in image guided surgery is presented. The method 
comprises: providing at least one pre-acquired image of a patient, the at least 
one image having an image space; aligning the image space and a detector 
space; tracking a three-dimensional position of a tool guide in the detector space, 
using at least one trackable marker provided on the tool guide, where the tool 
guide includes a plurality of cannulas; and relating the position of the cannulas 
with the at least one pre-acquired image. 

[0015] Combined positioning of surgical implements may mitigate the 
amount of estimation a surgeon performs when positioning implements 
individually. This can result in improved placement efficiency and reduced 
surgical procedure time. Additional savings in time may also be realized by 
reducing the number of pre-acquired images generated during a surgical 
procedure. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] The accompanying drawings, which are incorporated in and 
constitute a part of this specification, illustrate several embodiments of the 
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invention and together with the description, serve to explain the principles of the 
invention. 

[0017] FIG. 1 is a simplified block diagram of a system for the 
combined positioning of multiple surgical implements consistent with the present 
invention. 

[0018] FIG. 2 is a simplified side view of an embodiment of a system 
for the combined positioning of multiple surgical implements consistent with the 
present invention. 

[0019] FIG. 3 is a perspective view of an embodiment of a tool guide 
consistent with the present invention. 

[0020] FIG. 4 is a rear view of the embodiment of the tool guide shown 

in FIG. 2. 

[0021] FIG. 4a is a perspective view of another embodiment of a tool 
guide consistent with the present invention. 

[0022] FIG. 4b is another embodiment of the tool guide having the 
ability to adjust the relative angles between the cannulas. 

[0023] FIG. 5 is a block diagram of a process used to place surgical 
implements consistent with the present invention. 

[0024] FIG. 6 is a simplified block diagram of an exemplary computer 
system used in the surgical navigation system in accordance with one 
embodiment of the invention. 
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[0025] FIG. 7 is an exemplary diagram of a display consistent with an 
embodiment of the invention showing the trajectory of cannulas superimposed on 
images of a patient's anatomy. 

DETAILED DESCRIPTION 

[0026] Reference will now be made in detail to the present preferred 
embodiments of the invention, examples of which are illustrated in the 
accompanying drawings. Wherever possible, the same reference numbers will be 
used throughout the drawings to refer to the same or like parts. 

[0027] With reference to FIG. 1, there is shown schematically an 
apparatus in accordance with the present invention for the combined positioning 
of multiple surgical implements. Image-based surgical navigation system 100 
enables a surgeon to generate and display on monitor 115 a plurality of positions 
representing each cannula 127 of tool guide 125. Data representing one or more 
pre-acquired images 105 is fed to navigation computer 110. The pre-acquired 
images, generated prior to implement placement, typically are taken from 
different orientations and represent the region of interest of a patient's body 
which is to receive the implements. Navigation computer 110 tracks the position 
of tool guide 125 in real time utilizing a detector. The detector may be an sensor 
array 120 physically uncoupled from tool guide 125. Alternatively, the detector 
could also be at least one trackable marker 121 physically attached to or 
integrated into tool guide 125. Computer 110 then registers and displays the 
position of each cannula 127 with images 105 in real time to allow the surgeon to 
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properly position and orient the tool guide into the anatomy for implement 
placement. The pre-acquired images 105 are superimposed on the icons 
representing each cannula 127 on monitor 115. While the present invention 
described in more detail below is exemplified by a fluoroscopic-based system 
used for femoral neck fracture fixation, it is not limited to the described 
embodiment. 

[0028] FIG. 2 illustrates apparatus 125 in use with a preferred image- 
based surgical navigation system 200 according to one embodiment of the 
present invention. System 200, described below in sufficient detail to allow an 
understanding and appreciation of the present invention, is explained in greater 
detail in U.S. patent application Ser. No. 09/274,972 of David A. Simon et al„ 
entitled "Navigation Guidance via Computer Assisted Fluoroscopic Imaging," filed 
on Mar. 23, 1999, now U.S. Pat. No. 6,470,207, issued Oct. 22, 2002, the entire 
disclosure of which is hereby incorporated by reference. However, it must be 
understood that the invention is not confined to use with this particular image 
guided surgical system. 

[0029] Further referring to FIG. 2, an image-based surgical navigation 
system 200 for acquiring and displaying x-ray images appropriate for a given 
surgical implement procedure is shown. Pre-acquired images of patient 202 are 
collected when a patient, lying on platform 205, is placed within C-arm 212 of 
imaging device 210. The term "pre-acquired," as used herein, does not imply any 
specified time sequence. Pre-acquired images could be generated pre- 
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procedurally or intra-procedurally. Preferably, the images are taken before 
implement positioning is performed. 

[0030] C-arm 212 may be capable of rotating relative to patient 202, 
allowing images of the patient to be taken from multiple directions. For example, 
the surgeon may rotate C-arm 212 about its mechanical axis as shown by arrows 
228. Usually, images are taken from two substantially orthogonal directions, such 
as anterior-posterior (A-P) and lateral, of the anatomy which is to receive the 
surgical implements. One implementation of imaging device 210 is the Model 
9600 C-arm fluoroscope from OEC Medical Systems, Inc. of Salt Lake City, Utah. 

[0031] It is to be understood, however, that the invention is not 
confined to the use of a C-arm fluoroscopic device. Other embodiments of the 
invention could include imaging systems which produce 3-D volumetric data. 
Examples of such 3-D imaging systems include computer tomography, 
ultrasound, or magnetic resonance imaging. Functional imaging systems such 
as, for example, functional magnetic resonance imaging, positron emission 
tomography, single photon emission tomography, or magnetoencephalography, 
could also be used. 

[0032] Fluoroscopic images taken by imaging system 210 are 
transmitted to computer 226 where they may be forwarded to surgical navigation 
computer 110. Image transfer may be performed over a standard video 
connection or a digital link. Computer 110 provides the ability to display, via 
monitor 115, as well as save, digitally manipulate, or print a hard copy of the 
received images. Images, instead of, or in addition to, being displayed on monitor 
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115, may also be displayed to the surgeon through a heads-up display or some 
other type of appropriate display device. 

[0033] Although computers 226 and 110 are shown as two separate 
computers, they alternatively could be variously implemented as a single-chassis 
multi-processor computer or as a single computer that performs the functions 
performed by individual computers 110 and 226. In the single computer case, 
such computer would directly receive image data from image device 210 directly 
and detector 120. 

[0034] Further referring to FIG. 2, image-based surgical navigation 
system 100 generally performs the real-time tracking of tool guide 125, and, in 
the shown embodiment, also tracks the position of C-arm receiver section 216 
and anatomical reference frame 260. This embodiment utilizes a detector which 
includes a sensor array 120 which is suspended by mount 250. Sensor array 120 
may be located in such a manner as to provide a clear line of sight to the tracking 
markers on each tracked object (such as tracking markers 265, described more 
fully below). Sensor array 120 is coupled to computer 110 which may be 
programmed with software modules that analyze the signals transmitted by 
sensor array 120 to determine the position of each object in detector space. The 
manner in which the sensor array localizes the object is known in the art. See 
also, for example, PCT Application No. PCT/US95/12894 (Publication No. WO 
96/11624) to Bucholz, the entire disclosure of which is incorporated by reference. 

[0035] The tracking markers for each tracked object may be, for 
example, reflective markers and/or light emitting diodes (LEDs). Other devices 
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known in the art may be used that are capable of being tracked by a 
corresponding detector within the scope of the invention. For purposes of 
illustration, and not by limitation, the tracking means may be acoustic, magnetic, 
optical, electromagnetic, inertial, and radiological devices known in the art. It 
should also be understood that different tracking markers for each tracked object 
can be used. 

[0036] Not all of the tracking devices listed above are used in 
conjunction with sensor array 120. For example, a single electromagnetic 
tracking marker is actually a sensor which may be used to provide at least three 
degrees of spatial information in detector space. Some electromagnetic sensors 
can also provide additional attitude information, thus providing up to six degrees 
of positional information. Such sensors may also have no line of sight constraint 
which provides the advantage of functioning while embedded within a patient. 
The manner in which electromagnetic sensors localize an object is well known in 
the art. See also, for example, PCT Application No. PCT/GB93/01736 
(Publication No. WO 94/04938) to Bladen, the entire disclosure of which is 
incorporated by reference. 

[0037] In the embodiment of FIG. 2, anatomical reference frame 260, 
which incorporates a plurality of tracking markers 265, is attached to patient 202 
during an implement procedure. The reference frame may be securely attached 
to the anatomy in the region of the body which is to receive the implements. 
Reference frame 260 may be placed in a position so that the markers are visible 
to sensor array 120 during the image acquisition process and the implement 
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procedure. By sensing attached tracking markers 265, computer 110 can 
determine the position of the anatomy in detector space. This information is later 
used by computer 1 10 to register pixels found in the images to the position of the 
patient's anatomy as described in detector space. For purposes of this document, 
detector space is defined herein as the three-dimensional reference coordinate 
system associated with the detector. 

[0038] Further referring to FIG. 2, multiple cannula tool guide 125 may 
be tracked by surgical navigation system 100 using attached tracking markers 
230 in order for its position to be determined in detector space. Computer 110 
integrates this information with the pre-acquired images of patient 202 to produce 
a display which assists surgeon 270 when performing multiple implement 
procedures. Representations of multiple cannulas 127 are overlaid on the pre- 
acquired images of patient 202 and displayed on monitor 115. In this manner, 
surgeon 270 is able to see the location of the cannulas relative to the patient's 
anatomy, and can position and orient multiple implements into the desired portion 
of patient's body. 

[0039] Image-based surgical navigation system 100 utilized in the 
embodiment of the invention shown in FIG. 2 may be the same as that used in 
the FluoroNav.TM. system, which utilizes the StealthStation.RTM. Treatment 
Guidance Platform, both of which are available from Medtronic Sofamor Danek, 

Inc. 

[0040] FIG. 3 is a perspective drawing of an embodiment of tool guide 
125 which is optimized for the combined positioning of cannulated screws to 
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secure femoral neck fractures. A plurality of tracking markers 230 are positioned 
at points on the upper surface of frame 300. Frame 300 firmly attaches to a body 
305 of tool guide 125 by sliding onto a dovetail formed on the top of mounting 
post 380. Frame 300 may be interchanged with other frames which utilize 
different sizes or shapes, or tracking markers of a different type. In the 
embodiment shown in FIG. 3, tracking markers 230 may be infrared LEDs and/or 
reflective markers such as those supplied by Northern Digital Inc. 

[0041] For the embodiment shown in FIG. 3, tool guide 125 includes 
three substantially parallel cannulas 310a, 310b, 310c. Cannula 310a has a fixed 
length and the other cannulas 310b, 310c have lengths which are variable. 
However, in general, the invention could comprise a tool guide where all the 
cannulas, or any subset thereof, may have variable lengths. The variable length 
cannulas can be independently adjusted by the use of threaded means 330, 
which screw into interchangeable fixture 350 and are locked in place using a set 
screw or jam nut (not shown). Variable length cannulas allow tool guide 125 to 
adapt to the varying surface shapes associated with different bone structures. 
The surgeon, using information from the pre-acquired images, can make the 
proper length adjustment to each adjustable cannula during the pre-operative 
planning stage of the medical procedure. The cannulas may possess teeth 360a, 
360b, 360c at their distal end in order to effectively grip the patient's bone. 

[0042] Furthermore, tool guide 125 may have cannulas which have 
inner and outer diameters that are also variable. These diameters may be altered 
by simply interchanging a given cannula with another having differing diameters, 
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or alternatively, using cylindrical adapters to modify the diameters of an existing 
cannula. For example, the inner diameter of the lumen may be reduced by 
inserting a reduction sleeve which extends the length of the cannula. Various 
reductions in lumen diameter can be achieved through the insertion of one or 
more reduction sleeves. Alternatively, the outer diameter of a cannula may be 
increased in a similar manner by sliding one or more expansion sleeves over the 
outside of the cannula. Other embodiments of tool guides can be provided by 
changing fixture 350. For example, one such interchangeable fixture 350 could 
have cannulas with non-parallel, fixed angular offsets. In the embodiment of FIG. 
3, cannulas 310b and 310c can be removed by unscrewing them from fixture 
350. The fixture may then be slid off cannula 310a and replaced with another 
having different characteristics. For example, the number of cannulas can be 
varied by utilizing fixtures which have a different number of attachment points. 
Additionally, the relative geometry, or spread, between the cannulas can be 
varied by utilizing fixtures which have attachment points in different relative 
locations. Finally, the relative angulations among the cannulas may be altered 
from a parallel configuration by employing a fixture having attachment points with 
fixed angular offsets. 

[0043] Many different types of cannulas could be used with the 
invention in its broadest aspects. In the embodiment shown in FIG. 3, the 
cannulas 360a, 360b, 360c are preferably substantially rigid tubular members 
each having a lumen extending therethrough that is configured to allow for 
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passage of surgical implements, such as drills or other tools, and/or devices, 
such as cannulated screws, nails, etc. 

[0044] The surgeon typically holds and manipulates tool guide 125 by 
grasping handle 340 shown in FIG. 3. Alternatively, the invention could also be 
physically manipulated by a machine, such as, for example, a robotic arm. 
Machine manipulation could be facilitated through a coupling on body 305 which 
could allow tool guide 125 to be removably attached to a mechanized placement 
system. This arrangement could facilitate highly accurate placement of surgical 
implements, without usage of handle 340. 

[0045] FIG, 4 is a rear-view perspective drawing of the embodiment of 
tool guide 125 shown in FIG. 3. Situated towards the proximal end of the each 
cannula is a flange 370, attached to body 305. At the flange center is a 
countersunk hole 375 which leads to the lumen of the cannula. Flange 370 and 
hole 375 is a surgical implement receiver which assists the surgeon in the 
placement of implements down the cannulas once tool guide 125 is properly 
positioned in the patient's body. For a procedure, for example, to secure a 
femoral neck fracture, a drill with an attached guide wire is sequentially placed 
down each cannula after tool guide 125 has been appropriately positioned 
relative to the patient's body. The surgeon drills into the bone in order to anchor 
the guide wire. A cannulated screw is then placed over each guide wire and the 
screw is tapped into the bone at the fracture site. Once the screws are in place 
and secured, the guide wires are removed along with tool guide 125. 
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[0046] FIG. 4a shows an embodiment of a tool guide having 
electromagnetic sensors attached to cannulas 310a, 310b, and 310c. 
Electromagnetic sensors may be placed at the approximate mid-point of each 
cannula, as shown by 315a, 315b, and 315c, and/or they may be placed towards 
the tips of each cannula as shown by 317a, 317b, and 317c. Electromagnetic 
sensor groups 315a-c and 317a-c may be used separately or in conjunction with 
each other. Utilizing both groups can allow for the extraction of trajectory 
information of each cannula. Typically, each cannula would be equipped with 
separate electromagnetic sensors, however; some embodiments may have just 
one, or any subset of the total number of cannulas, equipped with 
electromagnetic sensors. 

[0047] FIG. 4b exemplifies another embodiment of a tool guide having 
cannulas with adjustable relative angles. Cannulas 401 and 402 are set in fixture 
405 such that the base of each cannula can pivot within the fixture. The angle of 
each cannula can be varied independently in the azimuth, .theta., 412 and 
elevation, .phi., 414 directions relative to fixture 405. After the angles for each 
cannula have been adjusted as desired, mechanism 410 can lock each cannula 
in place. Mechanism 410 can be a friction or compression lock, or any other type 
of locking mechanism known in the art. The orientation of cannulas 401, 402 
shown as mutually parallel in FIG. 4b is only for purposes of explanation, and not 
limitation. Other embodiments which allow the cannulas to have a varying 
angular position which are known in the art could be used. It should also be 
understood that the tool guide shown in FIG. 4b could have any number of 
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cannulas, and in addition to each angle being variable, each cannula could be 
individually adjusted in length. 

[0048] FIG. 5 is a flowchart illustrating methods for multiple implement 
positioning using image-based surgical navigation techniques. The surgeon may 
begin by acquiring one or more images of a patient. In one embodiment, these 
may be acquired with fluoroscopic x-ray imager 210, as shown in system of FIG. 
2. Alternatively, such images may be acquired with an imaging device with 
provides 3-D volumetric data (step 510). 

[0049] Computer 110 then retrieves a pre-acquired image and 
correlates the spatial coordinates defined by the images, known as image space, 
with the spatial coordinates defined by the detector, known as detector space. As 
shown in the embodiment of FIG. 2, computer 110 may retrieve a pre-acquired 
image from C-arm control computer 226. Computer 110 then determines location 
information of receiver section 216, and anatomical reference frame markers 
265, using sensor array 120. Computer 110 then correlates the images to 
anatomical reference marker 260, by determining and applying a geometric 
transform well known to those skilled in the art. Computer 110 then stores the 
image along with its positional information (step 520). The processes described 
in step 520 are repeated for each image to be acquired. 

[0050] The implement placement procedure starts once a detector and 
computer 110 detect and track the position of tool guide 125 relative to patient 
202 in detector space. With this information, computer 110 dynamically 
calculates, in real time, the projections of cannulas 127 into each image as tool 
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guide 125 is moved by surgeon 270. Typically, the surgeon places the cannulas 
into the patient percutaneously into the region of interest to position the 
implements (step 530). However, the invention can be used with other surgical 
techniques. 

[0051] Graphical representations of cannulas are superimposed on 
pre-acquired images and displayed on monitor 115. The cannulas can be 
displayed, simultaneously if desired, and in real time relative to the patient's 
anatomy (step 540). The surgeon, utilizing the display, can then manipulate tool 
guide 125 and position cannulas 127 in the region of interest. Using real-time 
display 115, the physician gets feedback on how the cannulas are oriented 
relative to the anatomy and then determines the optimal orientation (step 550). 
Once this is determined, the surgeon will then sequentially place the implements 
into the patient. If, for example, the procedure involves the fixation of a femoral 
neck fracture as previously described, the surgeon first places a drill with an 
attached guide wire down the cannula to drill into the bone at the fracture site 
and then anchor the guide wire into the bone. The surgeon then places a 
cannulated screw over the guide wire and down into the cannula. The screw taps 
into the bone at the fracture site and pulls the separate pieces of bone together. 
This process is repeated for each cannulated screw while the surgeon steadily 
holds tool guide 125 in place. Alternatively, the surgeon may place the guide 
wires using the cannulas and then remove the guide from patient's body. The 
surgeon would then position the screws by placing them over each guide wire, 
leading them to the bone into the fracture site (step 560). 
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[0052] Referring to FIG. 6, components and modules of a computer 
system 110 used to perform various processes of the present invention are 
described. Although a STEALTH STATION. RTM. image guided system 
manufactured by Medtronic Sofamor Danek has been identified, it will be 
appreciated that the present invention may be utilized with other types of 
computer systems. One aspect of the computer system 110 includes a graphical 
user interface system operating in conjunction with a display screen of a display 
monitor 115. The graphical user interface system is preferably implemented in 
conjunction with operating system 615 running computer 110 for displaying and 
managing the display objects of the system. The graphical user interface is 
implemented as part of the computer system 110 to receive input data and 
commands from a conventional keyboard 620 and mouse 625. For simplicity of 
the drawings and explanation, many components of a conventional computer 
system have not been illustrated such as address buffers, memory buffers, and 
other standard control circuits because these elements are well known in the art 
and a detailed description thereof is not necessary for understanding the present 
invention. A computer program used to implement the various steps of the 
present invention is generally located in memory unit 600, and the processes of 
the present invention are carried out through the use of a central processing unit 
(CPU) 605. Those skilled in the art will appreciate that the memory unit 600 is 
representative of both read-only memory and random access memory. The 
memory unit also includes a database 650 that stores data, for example, image 
data and tables, including such information as position data and geometric 
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transform parameters, used in conjunction with the present invention. CPU 605, 
in combination with the computer software comprising operating system 615, 
detection software module 630, tracking software module 635, calibration 
software module 640, and display software module 645, controls the operations 
and processes of computer system 110, The processes implemented by CPU 
605 may be communicated as electrical signals along bus 660 to an I/O interface 
670 and a video interface 675. 

[0053] Detection software module 630 utilizes signals from the detector 
and performs the processes associated with creating a coordinate reference 
system and detecting positions of reference images for use in connection with 
the present invention and are known to those skilled in the art. Tracking software 
module 635 performs the processes necessary for tracking objects in an image 
guided system as described herein and are known to those skilled in the art. 
Correlation software module 640 computes the geometric transform which 
registers the images to the detector space, and thus the patient's anatomy. 

[0054] Display software module 645 applies, and if necessary, 
computes the offsets between tool guide tracking markers 230 and the cannulas 
in order generate an icon representing each cannula for superposition over the 
images. For tool guides with fixed cannulas, these offsets can be measured once 
and stored in database 650. The user would then select from a list of tool guides 
which one was being used in the procedure so the proper offsets are applied by 
display software module 645. For tool guides with variable lengths and 
angulations, the offsets could be measured manually and entered via keyboard 
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620, or measured using the navigation system 100 in conjunction a tracked 
pointer or tracked registration jig (not shown). If a tracked pointer is used, the 
user will touch the tip and tail of each cannula while the tool guide is being 
tracked. The offsets are computed by display software module 645 and stored for 
later use. Similarly, if a tracked registration jig is used, the tool guide is placed 
within the jig while it is being tracked. The jig will measure the positions of the 
cannulas and display software module 645 will again compute the offsets and 
store them for later use in database 650. 

[0055] Pre-acquired image data 105 can be fed directly into computer 
110 digitally through I/O interface 670, or may be supplied as video data through 
video interface 675. In addition, items shown as stored in memory can also be 
stored, at least partially, on hard disk 680 if memory resources are limited. 
Furthermore, while not explicitly shown, image data may also be supplied over a 
network, through a mass storage device such as a hard drive, optical disks, tape 
drives, or any other type of data transfer and storage devices which are known in 
the art. 

[0056] FIG. 7 shows an exemplary diagram of display 700 illustrating 
an iconic graphical overlay of the cannulas for the preferred embodiment. Display 
700 is presented to the surgeon on monitor 1 15 of computer system 110. The left 
side of FIG. 7 shows a fluoroscopic image of an anterior-posterior view of a hip 
and femoral neck bone 710. Graphical overlays 715 are the iconic superposition 
of all the cannulas 127 attached to tool guide 125 within image 710. Graphical 
overlays 715 are directional indicators, displaying the position and orientation of 
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each cannula. In the embodiment shown in FIG. 7, these directional indicators 
are shown as lines, but other symbols may be used. As the surgeon moves tool 
guide 125, computer 110 recalculates and displays the new locations of the 
graphical overlays 715. The surgeon can use image 710 and overlays 715 to 
visualize, in real-time, the position and orientation of the cannulas relative to the 
patient's anatomy. 

[0057] For the embodiment shown in FIG. 2, the surgeon would like to 
acquire two substantially orthogonal fluoroscopic images of patient 202, such as 
images from an anterior-posterior view and a lateral view of the anatomy of 
interest. These two complementary views help the surgeon to better visualize 
how the cannulas are situated in the patient's anatomy. The orthogonal views are 
related to one another by a 90 degree rotation about the major axis of the patient 
(the axis running along the length of the patients body). The fluoroscopic image 
taken from the lateral view 720 is shown on the right side of FIG. 7, along with 
graphical overlays 717 showing the locations of the cannulas 127. 

[0058] In certain situations, the surgeon may wish to know where the 
tip of the cannulas would be if cannulas were projected along a line give by a tool 
guide's current trajectory. At the surgeon's command, computer 110 may 
calculate and display this projection based upon the current orientation and 
position of the cannulas. This orientation and position are determined by tracking 
the tip and the tail of each cannula. The estimated position of the tip can be 
calculated by computer 110 through projecting a fixed distance beyond the 
cannulas' tips in the direction of the line formed by each cannula's tip and tail. 
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The estimated position, or "look-ahead" trajectory, would be represented by a 
graphical overlay. As shown in FIG. 7, exemplary "look-ahead" trajectories 725 
and 727 are shown in a different line styles from overlay 715 and 717, 
respectively. This difference could also be a change in color, type, or texture 
between the look-ahead trajectory 725, 727 and the current position 715, 717. 
Computer 110 may vary the length of the look-ahead trajectory 725, 727 as 
directed by the surgeon through the graphical user interface control 730 and 
computer keyboard 620 or mouse 625. In this manner, computer 110 assists the 
surgeon in visualizing where the cannulas would be in the patient if they were 
advanced a predetermined distance into the body of the patient. 

[0059] Although the look-ahead technique described above projected 
the graphical representation of the cannulas into the image, there is no 
requirement that the cannulas' graphical representation be in the space of the 
image for look ahead trajectory 725, 727 to be projected into the image. In other 
words, for example, the surgeon may be holding tool guide 125 above the patient 
and outside the space of the image, so that the representation of the cannulas 
does not appear in the images. However, it may still be desirable to project 
ahead portion 725, 727 into the image to facilitate planning of the implement 
procedure. 

[0060] The look-ahead technique could be extended to include virtual 
implants. Graphical overlays representing implant structures such as prosthetic 
devices, plates, and fasteners such as screws, nails, etc., could be shown on 
display 115 during and after their placement into the patient's body. These 
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graphical overlays would provide additional information regarding the implants 
without involving the generation of new images, 

[0061] When cannulas 127 are perpendicular to the plane of the 
fluoroscopic image, the graphical overlay of the cannulas may virtually collapse 
to a point, potentially making it difficult to view them. To alleviate this, computer 
110 may optionally use a different graphical representation of cannulas 172 when 
the distance in the image plane between the tip and tail of the cannulas 127 
becomes smaller than some fixed distance. 

[0062] The foregoing description is presented for purposes of 
illustration and explanation. It is not intended to be exhaustive or to limit the 
invention to the precise form disclosed, and modifications of variations are 
possible in light of the above teachings or may be acquired from practice of the 
invention. The principles of the invention and its practical application enable one 
skilled in the art to utilize the invention in various embodiments and with various 
modifications as are suited to the particular use contemplated. 

[0063] For example, pre-acquired images obtained from modalities 
different than the C-arm fluoroscope x-ray imager may be used with the 
invention. Such modalities could supply 3-D volumetric data and may also 
include functional information. Such modalities may include, by way of example 
only, computer tomography, ultrasound, or magnetic resonance imaging. Imaging 
modalities which may provide functional information include functional magnetic 
resonance imaging, positron emission tomography, single photon emission 



Serial No. 10/801,906 
Page 26 of 27 



SUBSTUTUE SPECIFICATION 



tomography, magnetoencephalography, or any other modality known to those 
skilled in the art. 

[0064] Furthermore, the invention is not limited to the fixture of femoral 
neck fractures, but can be used for many different types of procedures such as 
the distal locking of intramedullary nails, in placing implements such as interbody 
fusion devices into the spine, anterior cervical plating systems, etc., or any other 
application where two or more implements are to be placed, especially multiple 
implements having fixed relative positions and angulations. 

1 5 i 44265,1 
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